Skip to content

Add support to configure multiple service ports#316

Merged
shivamerla merged 10 commits intoNVIDIA:mainfrom
shivamerla:support_multiple_service_ports
Mar 14, 2025
Merged

Add support to configure multiple service ports#316
shivamerla merged 10 commits intoNVIDIA:mainfrom
shivamerla:support_multiple_service_ports

Conversation

@shivamerla
Copy link
Copy Markdown
Collaborator

  • Default named port of "api" will be added with legacy .spec.port attribute
  • Ability to setup multiple named ports "api", "metrics" etc.
  • auto detection of metrics and api ports for probes and metrics collection

@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented Feb 7, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@shivamerla shivamerla requested review from shengnuo and varunrsekar and removed request for ArangoGutierrez February 7, 2025 23:13
Comment thread config/samples/apps_v1alpha1_nemoguardrails.yaml Outdated
Comment thread api/apps/v1alpha1/nemo_entitystore_types.go Outdated
Comment thread api/apps/v1alpha1/common_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_entitystore_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_datastore_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_datastore_types.go Outdated
Comment thread api/apps/v1alpha1/common_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_evaluator_types.go
Comment thread api/apps/v1alpha1/common_types.go Outdated
Comment thread api/apps/v1alpha1/common_types.go Outdated
Comment thread api/apps/v1alpha1/common_types_test.go Outdated
@shivamerla shivamerla force-pushed the support_multiple_service_ports branch from 11f0e22 to 4d4944e Compare February 14, 2025 04:05
@shivamerla shivamerla force-pushed the support_multiple_service_ports branch from 4d4944e to 41b8ae6 Compare March 7, 2025 07:13
Comment thread api/apps/v1alpha1/common_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_customizer_types.go
Comment thread api/apps/v1alpha1/nemo_customizer_types.go Outdated
@shivamerla shivamerla force-pushed the support_multiple_service_ports branch from 24913ab to cca9071 Compare March 11, 2025 17:26
@shivamerla shivamerla requested a review from varunrsekar March 11, 2025 17:27
@shivamerla shivamerla force-pushed the support_multiple_service_ports branch 4 times, most recently from 0eea118 to 18e13fd Compare March 13, 2025 22:50
 * Default named port of "api" will be added with legacy .spec.port attribute
 * Ability to setup multiple named ports "api", "metrics" etc.
 * auto detection of metrics and api ports for probes and metrics collection

Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
@shivamerla shivamerla force-pushed the support_multiple_service_ports branch from 18e13fd to 19ffd4a Compare March 14, 2025 00:16
Comment thread api/apps/v1alpha1/common_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_entitystore_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_evaluator_types.go Outdated
Comment thread api/apps/v1alpha1/nimservice_types.go
Comment thread manifests/service.yaml
Signed-off-by: Shiva Krishna, Merla <smerla@nvidia.com>
Copy link
Copy Markdown
Collaborator

@varunrsekar varunrsekar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@shivamerla shivamerla merged commit efda5cb into NVIDIA:main Mar 14, 2025
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants